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A framework for a quantum mechanical information theory is introduced that is based entirely 
on density operators, and gives rise to a unified description of classical correlation and quantum en- 
tanglement. Unlike in classical (Shannon) information theory, quantum (von Neumann) conditional 
entropies can be negative when considering quantum entangled systems, a fact related to quantum 
non-separability. The possibility that negative (virtual) information can be carried by entangled 
particles suggests a consistent interpretation of quantum informational processes. 
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Quantum information theory is a new field with po- 
tential implications for the conceptual foundations of 
quantum mechanics. It appears to be the basis for a 
proper understanding of the emerging fields of quantum 
computation quantum communication, and quantum 
cryptography^. Although fundamental results on the 
quantum noiseless coding theorem |^ and the capacity 
of quantum noisy channels [Q have been obtained re- 
cently, quantum information is still puzzling in many re- 
spects. This is especially true for quantum teleporta- 
tion and superdense coding, two purely quantum com- 
munication schemes devised recently Q. Indeed, these 
dual processes which rely on the quantum correlation be- 
tween the two members of a spatially separated Einstein- 
Podolsky-Rosen (EPR) pair are difficult to interpret in 
terms of information theory. We show in this Letter that 
these processes can be understood in a consistent way 
by exploiting a fundamental difference between Shan- 
non theory and an extended information theory that 
accounts for quantum entanglement. As we shall see, 
the latter allows for negative conditional entropy even 
though this is forbidden classically. This leads us to 
propose that such quantum informational processes can 
be described by diagrams — much like particle physics 
reactions — involving particles carrying negative (virtual) 
information. By analogy with anti-particles, we refer to 
them as anti-qubits. 

Previous attempts to describe quantum informational 
processes have generally relied on the formulas of classical 
information theory supplemented with quantum proba- 
bilities, not amplitudes. However, it has been realized 
since Schumacher |^ that the von Neumann entropy 
has an information-theoretical meaning, characterizing 
(asymptotically) the minimum amount of quantum re- 
sources required to code an ensemble of quantum states. 
This suggests that an extended information theory can 
be defined that explicitly takes quantum phases into ac- 
count, as attempted in this Letter. The theory described 
here characterizes multipartite quantum systems using 
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only density operators and von Neumann entropies. It 
includes Shannon theory as a special case but describes 
quantum entanglement as well, thereby providing a uni- 
fied treatment of classical and quantum information. To 
be specific, let us consider a composite system consist- 
ing of two (classical or quantum) variables, A and B, 
and outline in parallel the classical and our quantum 
information-theoretic treatment of it. In classical infor- 
mation theory, we define the Shannon entropy of ^ 

H{A) ^ -J2pia)\og^p{a) , (1) 

a 

where the variable A takes on value a with probability 
p{a). It is interpreted as the uncertainty about A [an 
analogous definition holds for H{B)]. The quantum ana- 
log is the von Neumann entropy S{pa) of a quantum 
source A described by the density operator pA, 

SiA)^~TTA[pAlog^PA], (2) 

where Tr^ denotes the trace over the degrees of free- 
dom associated with A. The von Neumann entropy 
reduces to a Shannon entropy if pA is a mixed state 
composed of orthogonal quantum states. The com- 
bined classical system AB is characterized by a joint 
probability p{a,b), and therefore by a joint entropy 
H{AB) = —J2a bPi'^^^)^'~'S2P{'^'^) which is the uncer- 
tainty about the entire system. The quantum defini- 
tion S{AB) ~ ^Tt[pab log2 Pab], a function of the den- 
sity operator of the combined system pad, is immedi- 
ate. The classical probabilities observe p{a) = J2bP(^^ ^) 
and p{b) = J2aPi^^^)y analogously, pA = Ttb[pab] and 
Pb — T^t^aIpab]- Note that Tr^i and Tr^ stand for par- 
tial traces, while Tr is the trace over the joint Hilbert 
space. The classical conditional entropy is defined as 
HiA\B) = H{AB)-H{B) = - Ea.bPK 6) log2P(a|fe), 
where p{a\b) = p{a, b)/p{b) is the probability of a condi- 
tional on 6; H{A\B) characterizes the remaining uncer- 
tainty about the source A when B is known. 
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Here, we propose that the correspondence between 
classical and quantum constructions can be extended by 
defining the von Neumann conditional entropy 



S{A\B) ^ -TiipAB \og^ Pa\b] 
based on a conditional "amplitude" operator 

PA\B = exp2(-crAB) = Um PAsi'i-A » Ps)"^^" 



(3) 



, (4) 



where o-ab = 1a ® log2 Pb — log2 Pab, 1a being the unit 
matrix in the Hilbert space of A, and (g) the tensor prod- 
uct in the joint Hilbert space. Eq. is a quantum 
generalization of the conditional probability p{a\b) and 
reduces to it in the classical limit (diagonal pab) 0- 
In general, Pa\b is a positive Hermitian operator on the 
joint Hilbert space [just as p{a\b) is a function of a and b], 
whose spectrum is invariant under frame changes of the 
product form Ua ® Ub on pab- We refer to pa\b as an 
amplitude operator to emphasize that it retains the quan- 
tum phases, in contrast to p(a\b). It is defined on the sup- 
port of Pab since the latter is included in the support of 
Ia'^Pb, so that S{A\B) is well-defined. Indeed, inserting 
Eq. (|) in Eq. (|) resuhs in SiA\B) ^ S{AB)-S{B), just 
as for Shannon entropies. However, pa\b is not a density 
operator as its eigenvalues can exceed 1, in which case 
the operator ctab is not positive semi-definite, in con- 
trast to its classical counterpart. It is precisely for this 
reason that the von Neumann conditional entropy can 
be negative. In Shannon theory, H{A\B) is always non- 
negative, reflecting that the classical entropy of a com- 
posite system AB cannot be lower than the entropy of 
any subsystem A or B, i.e., ma,x[H (A) , H {B)] < H{AB). 
Quantum entropies on the other hand are known to be 
non-monotonic, i.e., S{A) > S{AB) or S{B) > S{AB) is 
possible when A and B are quantum entangled subsys- 
tems (see, e.g., [^). The above operator-based formalism 
naturally accounts for this non-monotonicity. 

The appearance of nonclassical (> 1) eigenvalues of 
Pa\b and nonclassical (< 0) conditional entropies can be 
related to quantum non-separability and the violation of 
entropic Bell inequalities, as we show in It can be 

proven that any separable state pab = J2i ''^ip'^A ® Pb 
(with Q < Wi < 1 and Wi = 1) is such that 
CAB > 0, and is therefore associated with S{A\B) = 
Tr[pAB tJAs] > Thus, all the eigenvalues of pa\b 
(and Pb\a) are < 1 for any convex mixture of product 
states, which implies that it is a necessary condition for 
separability in a Hilbert space of arbitrary dimensions. A 
negative conditional entropy implies that Pa\b ^ 1 while 
the converse is not true, so that S{A\B) > is a weaker 
necessary condition. As an example, this criterion can be 
applied to two spin-1/2 particles in a Werner state, i.e., 
a mixture of a singlet fraction x and a random fraction 
(1 — a;). A simple calculation shows that pa\b admits 
three eigenvalues equal to (1 — x)/2, and a fourth equal 



to (1 -I- 3a;)/2. The above separability criterion is thus 
fulfilled when the latter does not exceed 1, that is for 
X < 1/3. Thus, for this particular case (in fact, for any 
mixture of Bell states) , our condition is simply equal to 
Peres' and then happens to be also sufficient. Nu- 
merical evidence suggests, however, that it is weaker than 
Peres' in general. This will be investigated elsewhere. 

In Shannon information theory, we define the mutual 
(or correlation) entropy H{A:B) = H{A) - H{A\B) as 
the decrease of the entropy of A due to the knowledge 
of B, resulting in H{A:B) = H{A) + H[B) - H{AB) = 
-Ea,bP("'^)log2P(a:^): where p(a:6) = p{a)p{b)/p{a,b) 
is a mutual probability. The mutual entropy corresponds 
to the information gained about A by measuring B. It is 
symmetric, i.e., H{A:B) = H{B:A), and can be viewed 
as the amount of entropy shared by A and B. Also, 
H{A:B) > 0, as the entropy of A can only be reduced 
through the knowledge of B. As we now show, a quan- 
tum mechanical extension of this concept can be straight- 
forwardly defined, i.e., we can construct a von Neumann 
mutual entvopy S{A:B) based on a mutual amplitude op- 
erator 



PA:B 



= lim 



(5) 



generalizing the mutual probability p{a:b). Again, the 
associated quantum mutual entropy 



S{A:B) = -TiipAB log2 PA:b] 



(6) 



is invariant under frame changes of the product form, and 
can be written as S{A:B) = S{A) + S{B) - S{AB). The 
quantum mutual entropy S{A:B) is a natural extension 
of H{A:B) which measures quantum as well as classical 
correlations, and reduces to it for diagonal density matri- 
ces (probability distributions). It does not discriminate 
purely quantum entanglement from correlation, however, 
but rather unifies their information-theoretic description. 
While S{A:B) > just as its classical counterpart, it 
can exceed the entire uncertainty of the source ensemble, 
namely 



S{A:B) < 2mm[S{A),S{B)] 



(7) 



as implied by the Araki-Lieb inequality (see g). This 
precisely occurs for quantum entangled subsystems, 
and is forbidden classically due to the non-negativity 
of the Shannon conditional entropy, i.e., H{A:B) < 
inm[H{A),H{B)]. 

The above unified treatment of classical and quantum 
correlation is illustrated by considering three limiting 
cases and their associated entropy Venn diagrams as de- 
fined in Fig. For independent quantum systems (I), 
one has pab — Pa® Pb, so that pa\b — Pa®'^b [anal- 
ogous to p{a\h) — p{a)] and S{A\B) = S{A), thereby 
saturating the lower bound S{A:B) = as in the clas- 
sical case. This is illustrated in Fig. |^b for two quan- 
tum bits (qubits), i.e., if systems A and B belong to 
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a 2-state Hilbert space. For two (maximally) classi- 
cally correlated systems (II), the classical upper bound 
S{A:B) = mm[S{A),S{B)] is saturated. The range 
between the classical and quantum upper bounds cor- 
responds to a purely quantum (classically forbidden) 
regime, namely quantum entanglement. The quantum 
upper bound, Eq. (|^), is saturated for maximally entan- 
gled systems such as EPR pairs (III): the conditional 
entropies are negative, while S{A:B) exceeds the value 
which defines 100% correlations, so that entanglement 
might be viewed as supercorrelation. 

FIG. 1. (a) Entropy Venn diagram for a bipartite sys- 
tem AB. (b) Diagram for two qubits with S{A) = S{B) = 1: 
(I) independent 50/50 mixtures of states |0) and (II) max- 
imally classically (anti)correlated qubits, i.e., a 50/50 mixture 
of |01) and |10); (III) fully entangled EPR state with wave- 
function 2-^/^(|01> - jlO)), or any Bell state in general. 



(a) (b) A B 




FIG. 2. Physical spacetime diagrams and quantum infor- 
mation dynamics diagrams for (a) quantum teleportation and 
(b) superdense coding. 

(a) (b) 
A B A B 




The information-theoretic formalism discussed here 
should thus be regarded as an extension of a classical 
formalism beyond its original range to identify the sig- 
nature of quantum dynamics. As shown in further work 
(see [|l2| and references therein), it can be successfully 
applied to multipartite entangled systems by extending 
Shannon construction [e.g., defining the quantum con- 
ditional mutual entropy S{A:B\C)]. Most of the stan- 
dard concepts of Shannon theory then find an intuitive 



quantum analog, which results in a convenient frame- 
work for analyzing quantum channels or error correction, 
for example. Here, we restrict ourselves to sketching an 
information-theoretic description of quantum teleporta- 
tion and superdense coding relying on this framework. 
We argue that a conservative picture of information flow 
in these processes, consistent with unitarity, is only pos- 
sible if the existence of negative conditional entropies is 
recognized [ p^ . 

The third diagram in Fig. ^ exhibits how the nega- 
tive conditional entropy of a member of an EPR pair, 
S{A\B) = —1, is balanced by the (unconditional) en- 
tropy S{B) = 1 of its partner. As entropy can be viewed 
as "latent" information, this suggests characterizing the 
members of an EPR pair by a virtual information content 
of ±1 bit 0, a concept that turns out to be very fruit- 
ful when analyzing the information flow. To distinguish 
these maximally entangled qubits, we call them ebits 
In this picture inspired by particle physics, the ebit (e) 
and anti-ebit (e) can be viewed as virtual conjugate par- 
ticles, and the preparation of an EPR pair appears as 
the creation of an "ee pair" from the entropy "vacuum" 
S{ee) = 0. The central point is that the virtual informa- 
tion content of an ebit can be revealed (i.e., converted to 
real information) in interactions with qubits and classi- 
cal bits (cbits), as we shall see. In quantum teleportation 
(see Fig. ^), an unknown qubit (q) is transported with 
perfect fidelity through the transmission of two cbits (2c), 
after the sender and the receiver have shared an ee pair. 
The sender performs a joint measurement (M) of the 
qubit and the ebit in the 2-particle Bell basis (i.e., 4 or- 
thogonal maximally entangled 2-particle states) , thereby 
generating 2 cbits. The receiver reconstructs the qubit 
from the 2 cbits by applying to e one of 4 possible uni- 
tary transforms (U) in the 1-particle Hilbert space. Only 
if the (virtual) information content of e and e is taken 
into account properly (1 bit and -1 bit, respectively) can 
the information flow be conserved through the (M) and 
(U) stages. More specifically, if q is maximally entan- 
gled with an external reference (not represented here), 
the entropy conservation rule for (M) is 

5(2c) = Siqe) = Siq) + 5(e) = 1 + 1 = 2, (8) 

since q and e are initially independent, while the condi- 
tional entropy of the remaining particle is S{e\qe) = — 1. 
At (U), we have 

S{q') = S{qee) = S{qe) + S{e\qe) = 2-1 = 1, (9) 

where q' is the outgoing qubit [l6| . In the particle physics 
language, if the e is replaced by an e going backwards in 
time (see diagram in lower half of Fig. |^a), the whole pro- 
cess is formally equivalent to the transmission of 1 qubit 
via 2 cbits, but with the additional burden of 1 ebit. A 
violation of causality by the e is prevented by the fact 
that its information content cannot be revealed without 
the presence of the 2 cbits, which travel causally. 
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In superdense coding (see Fig. ||b), 2 cbits are appar- 
ently transported via 1 qubit (a 2-state particle!). Our 
analysis suggests that the negative information content 
of the e is exploited by the sender so that 2 cbits can be 
packed into a single qubit via the unitary transform (U) . 
Subsequently, the receiver performs a joint measurement 
(M) of the qubit and ebit in the 2-particle Bell basis, 
thereby recovering the two encoded cbits. The entropy 
conservation rule for (U) is 

S{q\e) = S{2c e|e) = S{2c) + S{e\e) = 2-1 = 1, (10) 

since 2c and e are initially independent, while the uncon- 
ditional entropy of the remaining particle is >5'(e) = 1. At 
(M), we have 



5'(2c') = S{qe) = S{q\e) + 5(e) = 1 + 1 



(11) 



where 2c' are the outgoing cbits. The cbits 2c left with 
the sender must be ignored from an informational point 
of view, as they are correlated with 2c'. The factor 2 
that is apparently gained here is directly connected to 
the factor 2 in Eq. (0), and originates from the fact that 
S'(2c:g|e) = 2, that is, the additional information (about 
2c) conveyed by q when knowing e exceeds the entropy 
of g by a factor of 2. It is the maximum compression al- 
lowed by quantum mechanics (no other quantum commu- 
nication scheme could be more efficient). However, this 
compression is only apparent since the information flow is 
conserved in both (U) and (M) stages if a qubit-antiqubit 
picture is used. Formally, the 2 cbits are distributed over 
two particles (see lower half of Fig. ^) although the ebit 
does not appear during the considered period of trans- 
mission as it is sent backwards in time. 

We have proposed a quantum mechanical extension of 
Shannon information theory which incorporates entan- 
glement via negative conditional entropies. This analysis 
suggests the possibility that a qubit (the fundamental 
quantum of information) could have an analogously de- 
fined anti-qubit (a quantum of negative information), for- 
mally equivalent to a qubit traveling backwards in time as 
anticipated in The concept that negative virtual in- 
formation can be carried by entangled particles provides 
interesting insight into the information flow in quantum 
communication processes such as quantum teleportation 
and superdense coding. Furthermore, this leads us to 
conjecture that these processes can be recast into reac- 
tions involving information quanta (c, g, e, e) described 
by diagrams, much like particle physics reactions. The 
(M) and (U) operations then correspond to vertices (see 
lower half of Fig. ||) which describe the dual information- 
conserving processes (U) 2c -I- e ^ q and (M) q + e ^ 2c, 
summarizing Eqs. (jsj-^l]). As the ee contain no readable 
information, they cannot appear in the external lines of 
diagrams, just like the virtual particles of quantum field 
theory. 
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We define information as virtual if its extraction would 
violate causality. In other words, virtual information can- 
not give rise to superluminal communication between the 
two particles of an EPR pair. Whether positive or neg- 
ative virtual information is carried by a member of an 
EPR pair is not an intrinsic property of the particle, but 
rather can only be assigned after the information dynam- 
ics is completed. In teleportation or superdense coding, 
positive (virtual) information is carried by that particle 
which is measured. If both particles are measured {e.g., 
in Bell experiments), no information transfer can take 
place and no virtual information content can be assigned 
to either particle. 

The term ebit was coined in C.H. Bennett et ai, Phys. 
Rev. A 53, 2046 (1996) to describe the "shared entangle- 
ment" of two particles, as "an undirected informational 
resource" giving the ability to transmit information (al- 
though it is not information in itself). Here, an ebit (anti- 
ebit) is that member of an EPR pair which carries posi- 
tive (negative) virtual information. 

In this description, the cbits remain unamplified. The 
original teleportation scheme can be understood in a sim- 
ilar manner. Then, the leftover cbits after (U) are in 
a product state with q' , so that the remaining entropy 
S{2c) = 2 should not be included in the entropy bal- 
ance. It simply originates from the measurement of two 
jo) -I- |1) states in the standard basis, as revealed by a 
more detailed analysis. 
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